🕷️️ Job Radar • SCRAPING

freelancer.com 2026-04-22 🟠

🔹 Automated Walmart.ca Product Scraper
👤 Client: 🇮🇳 KANGRA, India Member since 2019-01-20
💰 Price: $26 Average bid
🚩 Problem: Extract daily product listings from specific Walmart.ca store locations to ensure up-to-date inventory data.
📦 Existing: Not specified

Specifications:

[Target] - Walmart.ca under a specific store location (set by postal code)
[Method] - Python with Scrapy, Selenium, or Playwright for headless scraping
[UI/UX] - N/A
[Stack] - Python, Scrapy/Selenium/Playwright, CSV/JSON output, cron job/scheduler
[Security] - Handle captchas and IP throttling, secure config file (.env)
[Format] - JSON or CSV

Workflow:

1. Set up a virtual environment for the project.
2. Install necessary dependencies (Scrapy/Selenium/Playwright, requests, json, csv).
3. Create a Scrapy/Selenium/Playwright spider to navigate Walmart.ca and scrape product data.
4. Implement logic to handle pagination, lazy-loaded content, and store selection prompts.
5. Add captcha handling mechanisms (e.g., reCAPTCHA) if necessary.
6. Configure the scheduler to run the scraper daily at a specified time.
7. Generate a sample dataset from a test run on the live site for validation.